Computer Science = 
Doing Cool Stuff with Computers? 
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My Research Group 


e Computer Security: computing in the 
presence of adversaries 

e Last summer student projects: 
- Privacy in Social Networks (Adrienne Felt) 
- Thwarting Spyware (Meghan Knoll) 
- Hiding Keys in Software (Carly Simpson) 
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Computer Science 


e Mathematics is about declarative 
(“what is”) knowledge; Computer 
Science is about imperative (“how 
to”) knowledge 


e The Study of Information Processes 


— How to describe them 


- How to predict their properties 
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Toaster Science = 
Doing Cool Stuff with Toasters? 
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Most Science is About 
Information Processes 


How can a (relatively) simple, 
single cell turn into a chicken? 


- How to implement them ; : 
quickly, cheaply, and reliably 
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Understanding Information Processes 


e Art: How to describe information 
processes 
- Designing programming languages 
- Inventing algorithms 

e Science: Predicting properties 
- What resources will a computation consume? 
- Will a program produce the correct output? 

e Engineering: Implementing processes 


- How to build hardware and software to 
efficiently carry out information processes 
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Mechanical Computing 
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Modeling Brains 


eRules for steps 
eRemember a 
little 


Ù “For the present I 


œ~ shall only say that 
the justification lies 
in the fact that the 
human memory is 
necessarily limited.” 
Alan Turing 
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“Computers” before WWII 
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Modeling Pencil and Paper 





How long should the tape be? 


“Computing is normally done by writing certain 

symbols on paper. We may suppose this paper is 

divided into squares like a child's arithmetic book.” 
Alan Turing, On computable numbers, with an 
application to the Entscheidungsproblem, 1936 
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Turing s Model 
olele lelolololo lolo lololo] 


Input: 1 
Write: 1 
Move: 








College Science Scholars 


What makes a Questions about Turing’s Model 
good model? 


e How well does it match “real” 
computers? 
- Can it do everything they can do? 
- Can they do everything it can do? 


e Does it help us understand and 
reason about computing? 


Copernicus 


4 F = GMM, / R? 


tolom Newton 
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Power of Turing Machine Universal Machine 


e Can it add? 


Result tape of running M on Input 
e Can it carry out any computation? T 


e Can it solve any problem? Machine 


A Universal Turing Machine can simulate 
any Turing Machine running on any Input! 
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Church-Turing Thesis 
e All mechanical computers are equally 
powerful* 


*Except for practical limits like memory size, time, 
energy, etc. 


e There exists a Turing machine that can 
simulate any mechanical computer 


e Any computer that is powerful enough 
to simulate a Turing machine, can 
simulate any mechanical computer 


Manchester Illuminated Universal Turing Machine, #9 
from http://www.verostko.com/manchester/manchester.html 
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What This Means 


e Your cell phone, watch, iPod, etc. has 
a processor powerful enough to 
simulate a Turing machine 


e A Turing machine can simulate the 
world’s most powerful supercomputer 


e Thus, your cell phone can simulate 
the world’s most powerful 
supercomputer (itll just take a lot 
longer and will run out of memory) 
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Are there problems 
computers can't solve? 


Recap 


e A computer is something that can 
carry out well-defined steps 


e All computers are equally powerful 


-If a machine can simulate any step of 
another machine, it can simulate the 
other machine (except for physical 
limits) 

- What matters is the program that 
defines the steps 
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The “Busy Beaver” Game 


e Design a Turing Machine that: 
- Uses two symbols (e.g., “0” and “1”) 
- Starts with a tape of all “O”s 
- Eventually halts (can’t run forever) 
- Has N states 

e Goal is to run for as many steps as 
possible (before halting) 


Tibor Radó, 1962 








BB(1) = 1 Most steps a 1-state 


machine that halts can make 
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Input: 1 
Write: 1 
Move: 
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30023277165235628289551030183413401851477543372467525003 

73381801735214240760383265881912082978202876698984017860 

713458482804223834928227 16051848585583668153797251438618 

5617302094 1548768557007853865875730485748722204003076984 

404509887 13670876150791383110343531646410779192098908371 

64477363289374225531955126023251172259034570155087303683 

65463087415599082251612993842583069137860727367070819016 

05255340770400392265930739979231701547753586298504217125 

13378527086223112680677973751790032937578520017666792246 

8399088559203629337677447608701284468834554 7780631649160 

18557844268607690279445427980061526931674528213366899174 

60886 10648657418901540119403485757771825306554 1632656334 

31424232559248670011850671658130342327174896542616040979 

71730737166888272814359046394456059281752540483211093060 

02474658968108793381912381812336227992839930833085933478 

853176574702776062858289 15656839229596358626365413938385 

67647280513949655544096884565781227432963199608083680945 

( 1 7 3 0 d j its) 36421039149584946758006509160985701328997026301708760235 

g 50023959811941059214262166961455282724442921741646549436 

38916971139653168926606117092900485806775661787157523545 

94049016719278069832866522332923541370293059667996001319 

37669855168384885147462515209456711061545198683989449088 

56870822449787745514532043585886615939797639351028965232 

Best found 95803940023673203101744986550732496850436999753711343067 

32867615814626929272337566201561282692410545484965841096 

bef 2001 15740312114406110889753498991567148886819523660180862466 

erore 1 87712098553077054825367434062671756760070388922117434932 

P 63344477313878371402373589871279027828837719826038006510 

on ly 925 di g ICS! 50757929252394534506229992082975795848934488862781276290 

44163292251815410053522246084552761513383934623129083266 
949377380950466643121689746511996847681275076313206 


6-state machine found by Buntrock and Marxen, 2001 
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Busy Beaver Numbers Finding BB(5) 


BB(1) = 1 e Why not just try all 5-state Turing 


— ? 
BB(2) = 6 Macnnes Transitions iron won © 


BB(3) = 21 5 possible states + Halt 

BB(4) = 107 * 2 possible write symbols 

BB(5) = Unknown! * 2 possible directions (L, R) 

- The best found so far is 47,176,870 P a -o ee ee 
1730 

C ta 5 states: (247)° 

~ 6.3 * 1013 
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The Halting Problem Example 


e Input: a description of a Turing 
MELAI 


e Output: “1” if it eventually halts, “0” 
if it never halts. 


Is it possible to design a Turing Machine 


that solves the Halting Problem? l 
O (it never 


Note: the solver must always finish! halts) 
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Example 


— 





Impossible to make 
Halting Problem Solver 


e If it outputs “O” on the input, the input 


machine would halt (so “0” cannot be 
correct) 


e If it outputs “1” on the input, the input 


machine never halts (so “1” cannot be 
correct) 


If it halts, it doesn’t halt! 
If it doesn’t halt, it halts! 





Summary 


e Computer Science is the study of 
information processes: all about 
problem solving 


- Almost all science today depends on 
computing 


- All computers are deeply equivalent 


- Some things cannot be computed by any 
machine 





Impossibility Proof! 


ST { 


1/1/L 0/0/H 





Busy Beaver Numbers 


e Input: N (number of states) 
e Output: BB(N) 


- The maximum number of steps a Turing 


Machine with N states can take before 
halting 


Is it possible to design a Turing Machine 
that solves the Busy Beaver Problem? 





Challenges 


e Specify a number bigger than 


BB(11111111111111111) onan 
index card 


e Find a TM with 6 states that halts 
after more than 10t730 steps 
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